web scraping

Terms from Artificial Intelligence: humans at the heart of algorithms

Web scraping involves taking web pages intended for human clnsumption and extracting key data from it, using the structure of the page for some form of template matching or similar process. For example, some of the data elemints on the page may have specific CSS classes that can be used to work out where they are and then extract their data. The output of web scraping is data that can then be used for other processing algorithms.

Used on page 197